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, Providing a history of the development and 
evaluation, this report discusses an information product designed to 
provide usef ul* inf ormtion ito th<?se responsible f#fr staff . 
development. The SotfrceBook' purpose is .to increase awareness o£ "the 
kinds of products that are available for training in instructional 
planning and management, and to provide sufficient information to 
.permit product screening, An^ overview including review guidelines, 
descriptions of 15 program packages, and an annotated list of 27 
supplementary training resources compose the three sections^ of the 
book, Thfe product evaluation is based on expert opinio-^ and* is 
included In, this report. (Author/DS) ^ 
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' This report is intended to provide .a history of the development ^and eYal- 
uation.of on% of the products produced by the. Educational ^^an3geIIfent Program. B 
Reference i§ ma^e in the "report to more detailed reports and memoranda which 

• • ^ / / < * • < > ' : 1 

document the development 'and prototype evaluation procedures used. All of 
the$e are available in program files." With one exception, they' were submitted. 
* to the funding agency as Progress RgpeHs , and sq atp not reproduced as a 
part* of this report * . , * • ^ • 

T^ie report has bejen prepared for those "who ^e.ed to make judgments about ^ 
the quality of the product, .but don't have time to become familiar 4 in. details 

-with the separate reports on the development, or to. examine the product itself. 

. . -- * ,* ^ * 

IMs SourceBook is essentially an infoimaticm product. The nature of informa- 
tion products is such that judgments about- their value must be based primarily 
on evidence about 'the care taken in th6ir preparation, and the opinions of 
qualified experts.* More definitive evaluation can be obtained, but the cost 
,can be quite high. In any case, funds for obtaining such, information were not' 



available' in this instance. 

/. If Readers are willing to base their judgments "on the record of development, , 
and on the authority and professional inciependence of those whose opinions are 
' reported, then this report will be useful in arriving at judgments about the 
product. Otherwise, it can be considered oi)lj as part of the documentation., of 

development. * ^ c 

* ^ . \ , ' Richard W. Watkins 

.i !' ' "Program Director 

► \ •* * Educational Management Program 
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, SoiirceBook of Training Prbduetg in Insttuctional Planriing and Manageipent 
Ite SourceBoolfc as one of the products developed to increase the skill 

• ~ " * A f ' t 

knowledg^aftd uncj^r standing of school personnel in the area of instructional 

% . planning and management. m p Ins true ticnal* planning is definect generally as that. 

* ■ . V* * ' 

«rea of educational /administration that is poncferned with providing educational 
opportunities foy children. , Ihis area may be furthgr defined as involving the 
establishment of "instructional program purposes','- the design an£ implementation 
of programs and the evaluation of instructional ^purposes/ T]ie SotirceBook was 
prepared tp provide * useful information to those. who are responsible for staff , 
development and are considering way^' to increase , capabilities in* instructional 
management. - r * 



Product Purposes and Description, ,/ » • 

The purpose of this SouyreBook is to increase awareness of the kinds of 
products that *kre available ss^prpviding tracing in instructions! planning 
and management, and to^prpvide sufficient information about tliese products tp 
peimit a preliminary screening, in "the process of planning Tor training. 

The book has three major sections. The first section presents an overview* 
N of instructional planning and management, and indludes some guidelines for re- 
viewing and selecting materials to train personnel in this area of staff develop 
ment. The second ,secti6n contains descriptions, of J.5 program packages that can 

be iirpllmented in a school district to meet specific needs fot training in in- 

% • ^ 

structiqnal planning and management. Many of these packages may also be used 
*.in college, or 'university courses. The descriptions are generally three or four 

pag&in length, and provide enough information to allow^ most users to -decide 
•^whether or not tp preview the program .package itself. The third .major section 



gives an. annotated list of 27 supplementary training resources that can be , % - \ 
useful* in conplementing # training programTln instructional plaiming and > ^ * . • 



management/ ^ . , " 

m. A proftact description <was .included in th& SourceBook i§ .the product met 

• * . ' • * -v ■ , ' * • . ' \ - 

all of the following five criteria:" (a) the product was intended to provide - . 

qr support training activities^ (b) the training was 'designated fo? middle 

management school personnel at the preschool, elementary or secondary levels; 

$J) the traininj^n^st be in '(the content are& of instructional planning^aprf 

management; (d) the completed product would be available for use )5y Jaiiuary 

' * ■ >' \ 

,1975>; and (e) the product had been made available within the last five years. 

The forty- two products that njet thesg criteria were selected from/a pool oF 

1$2 products which were reviewed. / } * * A 

/ V ' 

Product Development and Testing f - *; ' 

Early concept papers and program plans for the Educational Management 
Program noted that it would be necessary to provide ^rganized information about 
the .availability and usefulness of a variety o£ management training materials 
and support tools* Little ,attentioirwas given to detailed specification of 
the content 'arid format >of- this irif oi?nat ion. ia these. early documents, howeveK 

0 £ * • 

since the usefulness of information is so dependent on the characteristics and 
purposes of those who might be? seejcing the infoimation. Understanding ,of thesfe 

issues was greatly clarified as, a result of the efforts in developing training 

4 « ' N 

materials during the period* 1970-1972. ' In the field testing and early marketing 

ofv its products, the ^taff learned^that 'many usep .ofmanagemenf training 

* materials., including consultants who were ^advising school staffs about training, 



t 



were unaware of foe existence of useful programs or resources. These people 

recognized, the .need for more awareness, but s^id thfe time and cost of searching 
* ' * i \ - ♦ 

for information was prohibitive. * * «. 



Sate in 1&72/ initial search for and review of materials that could be 

useful to those concerned with instructional planning .were undertaken, and ~ 
\ • / . . * 

preliminary plans for ways that information planning about these materials 
might be organized were initiated. t A staff memorandum (1)* propos^ in. some 
detail a format for presentation that might be usecl systematically fbr a * , 

variety of materials, in this memorandum, an organizational, scheite for a 

* « . . — f 

catalogue w#s proposed that would .Capitalize on a matrix fbr organizing. 

. planning and management products that had been produced in.ttwo national confer • 

ences sponsored earlier by the Educational Management Program, The purppse of 

the conferences had been to assess plans *an<£ accori^lishments of a Variety of 
* . ** 

. agencies involved i^i/the development of products and program^ m this area. * 

The aeeds to be met and purposes to be accomplished by^ resource informa- 
tion product were considered in detail* in a gaper prepared in May 1923 (2) . 

The two product objectives established as a result of this analysis Were: (a) 

• V* / " . Is * . 

to create an awareness of alternative products available far improvement of 

school staff capability in instructional planning and management, and (b) to 
pro^de sufficient infoimation so that a preliminary screening of these alter- 
natives might be carried out. Preliminary screening implied that appropriate 
users, could at least eliminate those alternatives, lihat clearly would not meet 
their needs. Eight types of information resources (e.g., ERIC, SRIS, EPIE, 
IDEA*, various Catalogues) were analyzed in detail. The decision was made that 
a catalogue similar in form aid scope to the Sourcebook of Elementary* Programs 
\ and Projects . that h^d been developed as part of the ALERT System would best 
rmet all of the identified needs of potential users. Thus, the development of 
such a catllogue could be based on a tested model. It was estimated that ,as' 

niany as 100-150 products' might be available and appropriate^for inclusion in 

■J - I u ■ ■ ' * - • 

^uirfeexs in parentheses refer to documents listed in the bibliography. 



.the^propdsed catalogue. A prototype product description was prepared, and " 
tqntativet criteria Tor the identification of products for inclusi&i established. 
Extensive fJifoduct Search activities were ccintinued through 1973, 'and, a 



prototype catalogue containing tai entries was prepared by the en^of tlie year. 
The seatch indicated that the estimate^ that 100^150 products mightjje desci^d 

"\. - \ r • * * • * 

was too optimistic; 'the estimate was reduc^to a .maximi^ of forty. -|^There ^ere 
^three*pajor reasons , for this reduction: (a) very little useful informatit^i 



could be obtained from authors or developers* of many of the prQducts^iden£i?igd 
through literature searches; (b) the/time required to as^ent)le a$&>or|anize 

.complete information, whep available, was mu<jh greater tffart anticipate . 
tidily; and (c) the financial and staff resour^g? available for compleMon of 
this product were sharply reduced at the end of 1,973, Th^* plans fdj the prepa- 
ration and production o£ the catalogue were revised and restated in Novenber 

* N 1973-(3), and arrangements made to test the* prototype version. 

The prototype field test of the ten one-page descriptions indicated that 
the format was acceptable, but that additional^© rk was,needed to make the 

/. - • • . 

catalogue more appealing and Easier to read, Additionally, however, it identi- 

■* * 

fied several weaknesses. The categories from the matrix mentioned above, used . 

* T ■ - . \ ' * im \ * 

for presentation of information, were comprehensive; but the lack of available * 

information in each of the categories for many of the acceptable products 
*» • 

reduced greatly the ability to compare products. This problem was compounded 
• «*»*•. 

by the brevity of the information that could be presented .in the pne patge format. 
It also became evident 'that the informa^pn product to be developed could not 
really be a catalogue , in the accepted senSe of the teim, and that a somewhat 
< different orientation to work on the product would be necessary. > , 

ttecisions qji the format, content specifications £rid categories to be used 

* * * « 

in presentation t>f the product descriptions, and on criteria to be ^pplieii in 



the selection of products for incision in the Sourcebook were specified in 
detail, in a May 1974 progress report (4) . Hie criteria established at this 
time are those described above. At the time the progress report was prepared, 
152 products had been identified, and 86 had been classified as ineligible for 
# inclusjufei as judged -on one or more of the five criteria. Tv/e^ty- three programs 
and 29 support tools had befen tentatively identified as .eligible for inclusion. 
A review form of the Sourcebook containing 15 program gnd 29 resource 

; ; ' ■ * * . • * * 

descriptions Was produced in % Aagust^l974. The book" was *sent to the individual 
or organization responsible £or the development ahd/or distribution of each of 
the 15^pr6graj])s described, with a request that the description be reviewed for 
accuracy of the information presented. Four of the developers, who had a 
total of nine entries in the gourccBobk , indicated revisions that they judged 
to be necessary: Virtually all of these suggested changes were made right in 
,the. text fcf the description, and were incorporated in the final form of the 
book. The majority of the revisions related to price .changes, but a few of* 
them related to content of the •descriptions. Che program description was 
deleted entirely because the program would not be available by January 19?5; 
one new program description was prepared for the final version, when it was 

✓ / A * 

learned that the program would, in fact, be available for purchase in January . 

1\vo training resoqrce descriptions were added for the final version, at the 

suggestion of one of the program developers. The entire book was also sent 

for review to -tjjree people judged to be particularly knowledgeable about the 

needs and perspectives of educational management, and* two who are specialists 

- in the field of educational information ^dissemination and v utilization. The 

names, and institutional affiliations of these five expert* reviewers are: 

' v - * 

Robert K, Branson - Donald H. Coonbs 

* Florida 'State University University of Idaho- 



♦ David P. Crandall% Director William &,lf ' . 

NetWork .for Innovative Schools * ,.University of" Massachusetts 
f Nferrimac, Massachusetts • 11 • - , 

' . Arthur ^liayer ' - v 

Assistant Etffecutive Secretary - «;* ' 

Association" of California School Administrators \ 



The expert reviewers .were provided with % a Review Checklist, reproduced as 



pages 9-10 of this* report, at the tine the* review copy "of >tije book was sent to 
them.. All five reviewers made comments* in the book itself 9m and as requested, ' 
prepared a written report/ Comments from these reports are^excerpted or Sun- 
marized below. The complete reports a-re' available in the Program files. They 

y * 4 - ■ v 4 ^ , * 

are not' included in their entirety with this report, sirtfcS they, were not ini- 

■ 

tialiy prepared far wide scale dissemination. 

All of the reviewers expressed the .belief that there is a real need for a 
product like this SourceBook . The quotations below are excerpts from their re 
ports, with the name of the particular reviewer quoted shown in parentheses: 
"There is ho doifat in* my mind that school persornel. . .have a need 
for a SoupceBook such as this."' (Crandall) "Yejp, I believe this 
' resource book is addressed, to an important need o£ school staff. 
However, most people with whom I interact either ;aren f t cognizant 
of this need or aren't able to pay much attention "to it. 11 Qblty 
"The resource book is addressed to an important/need of school < 
staff... although it would seem to me that sqnewhat more manage- \- 
ment emphases could be added in subsequent volunes. The resource \ . 
book provides an* efficient vay of getting at a number of different r * 
kinds of information and I believe interested school people will ; 
fijid 'it useful."^ (Branson) 

None of the reviewers thought that the criteria used in the selection of 

N » ^ 

- -i — ' \ '* , ."*"'- 

products for description limited the. extent to which the book could be useful 



'I s 



in meeting the <needs o£ school sta|f ( (question 2 on the Review Checklist) , 

although «one reviewer did have reservations about excluding products published 

$ ~ * * • 

% 

more than five years ago.. He said he was*not convinced fl^at products that . 

• * y : . . 

would otherwise be^appropriate for inclusion would-be inappropriate. simply 
because thpy were more^ than five years old* Several reviewers suggested ad- 
ditional products that might be included 9 pr sources for products,' arid ope 
reviewer questioned the inclusion' of two products directed to improve'd staff 
communication skills under. the heading of* instructional planning,, and management 

In the cases of suggested additions, the suggested product^ either had. been 

■ • « » 

reviewed and rejected because they did not meet one or more of the. criteria, \ 

• » ^» ♦ * *#*• 

• * 

or the available infomiation was insufficient to prepare an entry. One " T 
reviewer suggested that we include in the catalogue a listing of all products 
reviewed but not included. This suggestion could not be followed, because th£. 
complete bibliographic entries for the products would have increased greatly 
the size of the book. \ ./_•-• 

The reviewers generally agreed that the SourceBook would fulfill its 
function as an informaticm resource topi, compared' favorably with other avail- 
able information resources, and is not redundant with existing information 
documents (questions 4, 5, and 6 in the Review Checklist) The following _ 
quotations- have beeh excepted from .the various reviews, with the specific \ 
reviewer's name following each quotation. 

f, I think with a few minor modifications it is an exemplary tool... 

Jt is not redundant to the best of my knowledge. !! . (Crandall) ,! I t 
even learned of programs'* of which I was hot aware. . .there arq" few % 
good sourcebooks" available or widely known;" (Thayer) 'The Sourcp- 
Book impresses me as a useful product awareness to.ol. \ think a , 
Eey~element is the chart on pages 6-7, because that is the one item ' 
in the book that pulls everything together. . .Some *of the infomiation 
resources/tools I coul£ conpare tfofe SourceBook to are in areas where 
the products are more comparable - where it is easier to define at- i 

.tributes and then be quite methodical in listing, their presence or 
absense. A good feature of the SourceBook «is that it's scope is 
narrow enoughso that considerable derail can be given 'about each 



'- 8 



/ 



product included. . .1 know of no other information resource tool 
whipH tries to do what the SourceBook tries to do. 11 (Cbombs) H I 
have used EPIE materials, PDK.< materials and other FWL materials. 

\ The SourceBook compares, quite favorably with. these r .1 have no 
knowledge of existing information documents which compete. . 

. (Wolf) . ' -* ' \ 

m 

t " • 

Responses to the remaining* questions on the checklist were, as expected, 

quite^detailed, since the # questions were posed to provide information to be 

used in revisieiVr-of the revfew version of the SourceBook . These comments can 

not be easily sunmarizecl, Vcfey were considered carefully when specific sugges- 

t# tions for change weije offered, and many of than were incorporated in the pre- 

paratioh.Q'f the. fiinal version of the SourceBook. ♦ 

. * . r t { ' . ' ^ ■ _ 

Conclusion * 4 ' " ; i ; \, ' 4 

The reviewer's comments, and other unsolicited comments 'from Far West 

Laboratory staff and from s.taf f members in the National Institute of Education 

who had seen the book, indicated clearly that the SourceBook bhould.be published, 

following revision as judged appropriate in light of the suggestions. The book , 

has been reproduced in 'limited quantity -by the Laboratory and is available fpr 

sale through the Laboratory at $3,95 a copy. One copy will be included with 

every set of. Coordinator's materials that are provided with the training products 

that have 1 been produced for sale by the Laboratory. 
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• . > - • Review Checklist 

Your evaluation of the SourceBook of Training Products in Instructional Planning 
and Management will provide important information to help us assess its effec- 
tiveness and to make appropriate .revisions* Please respond to each item listed 
below. Feel free ,a]^b to write comments in the So urceBook itself. . , C 

1. ' Do. you believe that this resource book is addressed to qn important 
V~ jjeedpf. school staff? r 9 - - 1 . # 



-2. Do you think the criteria^ applied in the selection of programs for 

inclusion in the SouyceBook (as described in the orientation pp, 3-4) • 
.limit too severely the extent to which the SourceBook can meet this, 
need? * . * *<"• « 

3. ^Do you know of training progr^ns that you ihirik should have been 

"included that are nofi? If so, assuming we knew of the program, do you 
think their bmissipn^fesul ted because a) pur criteria were too restric- 
: » tive. of **b)' we did ntft apply the criteria properly? 

^? * ' . ' 
.4, Comment whether the Soufce.Book adequately fulfills its function as 
a producv/ information awareness *tool. . "* * 

5. How -does the SourceBoqk compare with comparable information resources/ 
tools y$u have used? \ * 

* * ** " - , - " 

6 n ";Is / the Sourcebooks redundant with existing information docunents? If 

yes*, please fexplain- and identify existing materials. 

7i Comment on/tf]e format and organization of the SourceBook in terms of 
the following :f ? • p 

* a* "cover design * t * '% '] * * \ x . ^ - 

b. layout and presentation of content x • 4 * 

c. * sequence* of sections .and within sections, i.e., Intrgduction, 
Orientation, Program Reports Training Resources, Subject and 
Ptoduct lncjexes\ . , . 4 

d. .style sold clarify of presentation, particularly technicality of 
language ^understandability, interest level, etc.; " * 

e. specific suggestions ^for improving' organization and/or format. 

8. QDJimettt on the Program Reports (pp;, 5-68) in terms pf the following: 

a*, -utility of suumary chart (pp/ 6 : 7) and need for addition/deletion 
\ i of descriptive eolumjr ^categories • . • - , 

• b, clarity and-consistency of program, descriptions 

c. ?ieect fo;r a^it ion/deletion of categories in .descriptions of programs 
* i,e.,*ar.e other types of infoimation needed? \ w * 
Y f d. adequacy £* level of detail s in program descriptions 

'eV need f6r addition/deletion of programs (If addition, *speciiy^title, 
developer, |ddi;e*Ss, 'etc. , for -obtaining product and' information 
. about it. If deletion, specify title of program and explain.) * 

f. currency, timeliness, subjeqfryarea relevance of programs described/ 1 
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' 9, Comment an content, quality, and value o£ other sections of 
SourceBook: " p 



10, 



11. 



the 



a • Introduction 

b . Orientation 

c. Training Resources 
<L Subject Index 

e • Product Index 



\ 



the 



» 

How could the SourceBook be improved or made more useSSul in 
following areas: \ 

a* as an information tool 

b. in terns of content area/program coverage ; ^ 

Include here any comment or critique on the SourceBook , its content, 
organization, foimat, etc., not covered by the above items. 



ERIC 



14 



11 - 



BIBLIOGRAPHY ---c 





til 



* The following memoranda and reports were prepared by" Educational Management 
Rrogram staff during the course of the conceptualization," planning, and develop- 
ment of the SourceBook of Training Products in Instructional Planning and Manage- 
,ment. All but the first,, which is a staff memorandum, were^siibmitted as milestone 
reports y>. the National Institute of Education. They are arranged here by date. 

' ; \ * * 

• Oakley, Gail "EMRS Catalogue" Staff memorandum, March 1973. 

t 

2. "Educational Management Resource System Catalogue --AJStaff. Paper 

j * * V • ^ " ' " 

Hay 1973. , ( . 

3. "End of Year Progress Report on 1973 Scope of "Work," 'pp 93-97,.* 

* November 1975. * 

4., "Work Unit 11: Instructional planning Resource Catalogue Progress 
* Report," May.19 74. * 



15 



